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Abstract 

We show that the number of KLD (Karhunen-Loeve decomposition) modes 
-Ckld(Z) needed to capture a fraction / of the total variance of an extensively 
chaotic state scales extensively with subsystem volume V. This allows a 
correlation length £kld(/) to be defined that is easily calculated from spatially 
localized data. We show that £kld(/) has a parametric dependence similar 
to that of the dimension correlation length and demonstrate that this length 
can be used to characterize high-dimensional inhomogeneous spatiotemporal 
chaos. 
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Spatiotemporal states that are nonperiodic both in space and time abound in nature 
and are often important technologically, e.g, for lasers, fibrillating hearts, and convective 
transport of heat |]J . Experiments and simulations of these dynamics raise questions that are 
presently poorly understood: Are there different kinds of spatiotemporal nonperiodic states? 
What kinds of bifurcations lead to such states? How do inhomogeneities and boundary 
conditions affect the dynamics? And how does the transport of energy and matter depend 
on the details of the spatiotemporal disorder? An essential first step towards answering these 
questions is to develop methods to quantify spatiotemporal dynamic states, so that one state 
can be distinguished from another and so that theory can be compared with experiment and 
with simulation. Data analysis and theoretical progress are presently limited by a scarcity 
of concepts and of computational tools for analyzing spatiotemporal disorder. 

In the absence of a fundamental theory of sustained nonequilibrium systems that could in- 
dicate appropriate quantities to measure, researchers have used primarily two approaches for 
quantifying spatiotemporal disorder: two-point correlation functions and dynamical invari- 
ants such as Lyapunov exponents and fractal dimensions 0. Temporal correlation functions 
have been effective for distinguishing periodic and quasiperiodic dynamical states from each 
other and from chaotic ones [|3| while spatial correlation functions have played an important 
role in discovering and demonstrating the absence of long range spatial order Q. Both 
correlation functions have been less useful for distinguishing one chaotic state from another 
or for comparing experimental with computational chaotic data. Dynamical invariants have 
been somewhat useful for ordering the chaotic states of low-dimensional dynamical systems 
but severe difficulties remain in calculating these quantities for higher- dimensional systems 
because of the demanding computational effort, the slow and often ambiguous convergence 
of time-series-based algorithms, and the need for large amounts of noise-free data 0. 

In this Letter, we propose and analyze a new measure of spatiotemporal disorder, a 
correlation length £kld defined below, that seems promising especially for the analysis of 
large, high-dimensional, nontransient, driven-dissipative systems. This quantity has some of 
the flavor of correlation functions and also of dynamical invariants and is straightforward to 
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compute with moderate amounts of spatiotemporal data (unlike global dynamical invariants 
like the fractal dimension) since, as we show below, it is a local quantity that can be cal- 
culated from spatiotemporal data associated with a finite region of space. This last feature 
suggests that £kld will De useful for studying spatially inhomogeneous dynamics arising from 
slowly changing external parameters, from broken symmetries ||, or from the influence of 
boundaries 0. As is the case for many measures of spatiotemporal chaos, the length £kld 
can not be evaluated analytically and so we investigate its properties numerically for two 
idealized mathematical models — the one- dimensional Kuramoto-Sivashinsky (KS) equation 
H|, II and the two-dimensional Miller-Huse model — whose spatiotemporal chaotic solu- 
tions have been thoroughly studied and for which inhomogeneities can be introduced in a 
controlled manner. In later work, applications to experimental data will be reported. 

Our motivation for defining and studying the correlation length £kld comes from three 
different ideas. First is the idea of extensive chaos, that a sufficiently big homogeneous 
spatiotemporal chaotic system has the property that its fractal dimension D is extensive, 
growing in proportion to the system volume V P|, |IT)|-|T2"|] . This extensive scaling suggests that 
bounded intensive quantities, such as a dimension density 5 = liniy^oo D/V or the equivalent 
dimension correlation length = 5~ l l d IBfl (where d is the number of asymptotically 



large spatial dimensions, e.g., d = 2 for a large-aspect-ratio convection experiment) are more 
appropriate for characterizing large nonequilibrium systems. It was shown recently that the 
length £5 varies independently of the two-point and mutual-information correlation lengths 



so that the average spatial disorder does not determine the fractal dimension D [13]. This 
suggests that certain measures of spatiotemporal dynamics should be sensitive to structure 
in phase space, not just to instantaneous |L4] or time-averaged measures of spatial disorder 



in configuration space. The quantity £kld turns out to have this property. 

The second idea is to extend the concept of local thermodynamic equilibrium jl|, page 
13] to slowly-varying inhomogeneous driven dissipative systems, with the implication that 
intensive dynamical quantities can be defined locally and will be slowly varying in space. As 
an illustration, assume that a large sustained nonequilibrium systems has a parameter p(x) 



that varies slowly with position x and consider a subsystem of size L centered at position xq. 
Then over a certain time scale that decreases with decreasing subsystem size L (not nec- 
essarily diffusively), this subsystem will be approximately nontransient, even if the system 
containing the subsystem is not. Further, the values of intensive parameters associated with 
this approximately nontransient subsystem should correspond closely in value to those of an 
infinite homogeneous nontransient system with the parameter value p(xq). Unfortunately, 
there are no reliable algorithms that can estimate intensive quantities such as the dimension 
density 5 from information localized to some region of space (it is not even known whether 
such algorithms exist in principle). To date, calculations of intensive quantities such as the 
Lyapunov dimension density S have relied on the expensive calculation of global extensive 



quantities followed by taking the limit of some intensive ratio This is impractical for 
the analysis of experimental data or for the evaluation of local measures. As we show below, 
the measure £kld is a ble to indicate some of the behavior of the fractal dimension density 
using just local information. 

The third idea is to make use of the Karhunen-Loeve decomposition (KLD), which has 
been used by researchers over many years and in many disciplines to analyze spatiotemporal 



data [ , although not in the context of extensive chaos or of inhomogeneous systems. The 
KLD is a statistical method for compressing spatiotemporal data by finding the largest 
linear subspace that contains substantial statistical variations of the data. To illustrate the 
idea in the discrete case and also to introduce some notation, we consider a one-dimensional 
zero-mean field u(t, x) on a spatial interval [0, L] whose values are measured on a finite space- 
time mesh of T uniformly sampled time points = iAt and of S uniformly sampled spatial 
points Xj = jAx. Then aTxS 1 rectangular data matrix Ay = u(ti, Xj) can be defined from 
which a S x S symmetric positive semidefinite scatter matrix M = A T A can be calculated, 
where A T denotes the matrix transpose of A. Using standard eigenvalue methods with 
complexity 0(S 3 ) [17], the scatter matrix can be diagonalized to obtain its nonnegative 
eigenvalues of which can be further ordered in decreasing size a\ > o\ ■ ■ ■ > o| > 0. 

Since the ordered eigenvalues of often decrease rapidly in magnitude with increasing 



index i, researchers [[OJ have introduced a positive integer -Dkld(Z): 




(1) 



which represents the number of KLD modes needed to capture some specified fraction / < 1 
of the total variance J2i=i °f of the data. Researchers have suggested using D KLD (f) like a 



needed when interpreting -Dkld(/)- The T S'-dimensional vectors defined by the rows of the 
data matrix A constitute an embedding of the dynamics into a S'-dimensional phase space. 
The quantity Z?kld(/) indicates the dimension of a linear subspace that includes most of the 
statistical variation of this embedding and is generally quite different from the attractor's 
fractal dimension D, e.g., a limit cycle with fractal dimension D = 1 in a iV-dimensional 
phase space could have a value of D KLD (f) between 1 and N depending on how the limit 
cycle is folded in different orthogonal directions. 

Although -Dkld(Z) need have no particular relation to the data's fractal dimension D, 
we argue below that for extensive chaos, the rate of increase of -Dkld(Z) with volume V 
will generally be similar to the rate of increase of fractal dimension D with V since the 
extensivity of the dimension arises from the appearance of new orthogonal directions, i.e., 
with increasing V, a larger linear space is needed to contain the increasing variance of of 
the attractor. If true, we can then use the more readily calculated quantity -Dkld(/) to 
estimate intensive correlation lengths like the length £5 discussed above, and to study the 
dependence of such lengths on system parameters. 

We now present some results that justify and illustrate these observations. When evalu- 
ated for spatiotemporal data of a large, approximately homogeneous, sustained nonequilib- 
rium system of volume V, the KLD dimension -Drld(/) of Eq. ([!]) grows extensively with V 
as shown in Fig. IB. Here we have used T x S data matrices A (with 10 4 < T < 2 x 10 4 
and 100 < S < 800) derived from the spatiotemporal field u(t, x) of the one-dimensional 
Kuramoto-Sivashinsky equation 



fractal dimension D to measure the complexity of spatiotemporal data [PJ although care is 



d t u + d 2 x u + <9 4 



u + u d x u = 0, 



xe[Q,L], 



(2) 
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with rigid boundary conditions u = d x u = at x = and at x = L. Eq. (0) was integrated 
numerically with a semi-implicit finite-difference method that was first- and second-order 
accurate in time and space respectively. For L > 50, most initial conditions yield spatiotem- 
poral chaotic states that were previously shown to be extensively chaotic |IT[ . Fig [l](a) 



shows that -Dkld(Z) is extensive for L > 50, growing in proportion to the system volume L 
with a slope that depends on the fraction /. The dashed line indicates the extensive scaling 
of the Lyapunov dimension D |ll| which corresponds to a fraction / = 0.81. Fig 0(b) shows 



further that -Dkld(Z) is extensive for open subsystems centered on the middle of a system of 
size L = 400. The slope of a line in Fig|l|(b) for a given fraction / is the same as the slope of 
the line of corresponding / in Fig|l|(a). This implies the important point that the intensive 
density limy^oo D KLD (f) /V can be estimated from information localized to a certain region 
of space. 

The extensivity of the KLD dimension, for both the entire system and for subsystems, 
suggests introducing an intensive KLD correlation length ^kld(/) : 

W/^lLm^p, (3) 

by analogy to the dimension correlation length (where again d is the spatial dimensionality 
of the system). Based on the data in Fig. [l] for the KS equation, Fig. ^| shows how the 
length £kld(/) varies with the fraction /. The dependence is nonlinear, with the magnitude 
of £kld(/) changing by a factor of ten over the range 0.3 < / < 1. Contrary to an earlier 
claim by Ciliberto and Nicolaenko , Fig. ^| shows that the fractal dimension of a high- 



dimensional system can not generally be estimated from a knowledge of £kld(/) since the 
fraction / corresponding to the dimension correlation length will not be known in advance 
and because £kld(/) can vary substantially with /. However, the onset of extensivity 
for -Dkld(/) does accurately predict the onset of extensivity for the Lyapunov dimension D 
with increasing volume V. 

Fig. |3| shows how the length £kld(/) (for / = 0.95) compares with the dimension corre- 
lation length £s (derived from the extensive Lyapunov fractal dimension for a nonequi- 
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librium Ising-like phase-transition of a mathematical model invented by Miller and Huse [|9] . 
The Miller- Huse (MH) model is a 2d coupled-map-lattice for which a Id chaotic map of odd 
symmetry is placed at each node of a periodic L x L square lattice. Each site is coupled 
diffusively to nearest neighbors with a strength g that acts as the bifurcation parameter for 
this system. Miller and Huse found that a quantity analogous to a lattice magnetization M 
bifurcated from a zero to non-zero value at a critical value g c = 0.205 at which point also 
a two-point correlation length £2 diverged to infinity. O'Hern et al |13| showed that the 



dimension correlation length £5 did not diverge near g c but instead was a quantity of order 
one that smoothly reached a local maximum at a value g = 0.200 distinctly less than the 
critical value g c . Fig. |3| shows that the length £kld is somewhat larger than £5 and has a 
qualitatively similar dependence on g in that it increases to a local maximum at the same 
g-value. Unlike the dimension correlation length, £kld does not seem to vary smoothly 
near its maximum but we lack sufficient numerical resolution to determine unambiguously 
whether there is a finite jump in value, in analogy to the dependence of specific heat on 
temperature for a second-order equilibrium phase transition. The functional dependence of 
£kld(/) 011 parameter g depends only weakly on the fraction / which therefore is not an 
important parameter. 

Finally, in Fig. |] we demonstrate how the KLD correlation length £kld can De used to 
characterize inhomogeneous spatiotemporal chaos, a result that opens up interesting possi- 
bilities for the future analysis of experimental data. For this figure, we introduced a spatial 
inhomogeneity into a 300 x 30 periodic MH lattice by allowing the coupling constant g = g(x) 
to vary periodically in the x lattice direction as shown in Fig. f|(b). At each of several x- 
coordinates i, we calculated the KLD dimension Eq. (U) for subsystems centered on i and of 
increasing width L with 9 < L < 15. From these data, local extensive scaling was identified 
from which a length £kld(*) was calculated from Eq. (H). In Fig. f|(a), the lengths £kld(0 
are given by the solid circles which can be compared with the dashed-curve representing the 
corresponding value of £kld that would be obtained from Fig. ^| for an infinite homogeneous 
system with constant value g = g(i). The agreement is good to about 4% throughout, which 



is sufficient to determine the spatial dependence of the inhomogeneity. 

In conclusion, the correlation length Eq. (^) obtained by studying the extensive scaling 
of the Karhunen-Loeve decomposition with increasing subsystem volume provides an eas- 
ily calculated and novel way to characterize the spatiotemporal disorder of an extensively 
chaotic system, including the case of slowly varying spatial inhomogeneities. We believe 
that the ideas on which our analysis is based — namely extensivity, local stationarity, and 
the Karhunen-Loeve decomposition — will be important ingredients in the future analysis of 
large nonequilibrium systems. 

This work was supported by a DOE Computational Science Fellowship, by NSF 
grants NSF-DMS-93-07893 and NSF-CDA-92123483-04, and by DOE grant DOE-DE-FG05- 
94ER25214. 
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FIGURES 

FIG. 1. (a) KLD dimension Dkld(/) Fq. (|l]) versus system size L for Eq. (g) with rigid 
boundary conditions, for system sizes 50 < L < 400. The percentage labels indicate the value 
of the fraction / for each curve. After integrating 10 6 time steps to allow transients to decay, 
T = 2 x 10 4 time-samples with step At = 2 time units were used to construct the scatter matrix M. 



The dashed line shows the extensive Lyapunov dimension from Ref. [11] which corresponds to a 
fraction / = 0.81. (b) For the same numerical parameters and for a fixed system size of 400, a 
plot of -Dkld(/) versus subsystem size L of the Id KS equation. The subsystems were centered 
at x = 200. In both (a) and (b), the slopes of the lines corresponding to the same / values are the 
same. 

FIG. 2. KLD correlation length £kld(/) versus fraction / for the data of Fig. |l], showing a 
nonlinear dependence over an order of magnitude in £kld(/)- 

FIG. 3. (a) Comparison of the KLD and Lyapunov dimension correlation lengths (squares and 
circles respectively) for the non-equilibrium transition of the 2d Miller-Huse model, for which the 
two-point correlation length £2 diverges at g = 0.205 Q. The values for £5 were taken from Ref. [13] 



while the values for £kld(/) were calculated for the fraction / = 0.95 using spatiotemporal data 
of the Miller-Huse model on a 2D square lattice of size L = 30 with periodic boundary conditions. 
After a transient time of 2 x 10 6 iterations, T = 10 4 time-samples of S = L 2 lattice sites in the 
range 12 2 < S < 20 2 were used to define the data matrix A. The double-headed arrow indicates 
the range in parameter g used to study weakly inhomogeneous dynamics in Fig. ||. 
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FIG. 4. (a) KLD correlation length £kld(/) with / = 0.95 (solid circles) versus spatial 
coordinate i for a weakly inhomogeneous 2D Miller-Huse model on a square lattice with periodic 
boundary conditions, with rectangular geometry L x = 300 and L y = 30. The solid circles were 
obtained by studying the extensive scaling of -Dkld(/) for subsystems of size L x = 9, 11, 13, 
and 15 centered on the particular coordinate i. The dashed curve in (a) represents the value 
of £kld(/) interpolated from Fig. ||, corresponding to an infinite nontransient homogeneous system 
with constant value g(i) corresponding to that particular location in space. The scatter matrix 
was calculated from T = 10 4 time-samples after waiting 2 x 10 6 time units for transients to 
decay, (b) The coupling constant g(i) varied spatially in the x-direction according to the equation 
g = 0.17 + 0.02 sin(27ri/300). 
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